EVENTS IN FHE ELSEWHERE 


Cur working process for this project has involved a series of 
experiments to develop the technology required to accomplish the kind of 
direct connection between the live performer and the stage environment. 
Essentially we have been attempting to redefine the theatrical experience 
by giving direct control of all parameters of the theatrical environment to 
the performer. These parameters include but are not limited ta: lights, live 
camera motion, triggering and speed of pre-recorded video images, onstage 
prop movement and menipulation of sound sequences. 


Cirect Sound/Image Response 
Our initial experiments were in direct sound/image response performed 


in realtime. The voice was used to cut between two separate pre-recorded 
Images using matte and masking techniques. The matte literally cuts a hole 
in the video image into which 6 second video image is placed. Masking 
obstructs the image. By choosing specific frequencies tn the voice which 
were harmonics of the two frequencies into which video is jacked (15750 
cueles per second for herizontal roli and 60 cucles per second for vertical), 
we were able fo have the voice effect control over heternriining, ete. Thus 
we were able ta achieve a coherent relationsnip between the live 
performance of the voice and the resulting matte and masking of layered 
video Images. 

The sound material had to be focussed in a specific way in order to 
affect the irnage key. While a great deal of vocal material could be included, 
only certain aspects of the material actually affected the video intertace. 
This voltage and frequency information yas sent to the R/E scan processor 
which translated the information into a coherent television frame. The 
Information from the san processor is fed as 4 television signal into 4 
Sstendard video mixer where ts it used in various modes, mostly as an 
external key to provide a syntactic relationship between two video images. 
45 only certain parameters of possible voce] matenel were translateble to 
the R/E scan processor, the singer, using the voice as sound source hed to 
learn to “play” the video tmages as an instrument, organizing vocal! material 
with regard to how it affected the onscreen tmeges and the mudulatian 
hnetween the two separate pre-recorded images within the layering process. 

The compositional process then was both intuitive and fixed, with regard 
LO the material which actually affected 6 perceivable result. 


softwere interface with Computer 
Devices were developed at STEIM in Amsterdam and by Russ@§ Grizzo and 
Jody Niesen of Los Alamos laboratories, which controlled stepper motars. 
Mark Coniglio and Morton Subotnick have been developing Interactor’, a 
software program which allows direct interaction between variaus aspects 
of performance and computer controls, translating these aspects into \; LS 
numerical information and thus readable by MIDI compatible devices. _.. ae 
By connecting the voice, through microphone, to ajpitch rider|we were 
able to translate this analog sound into digital MIDI code. Then by accessing 
Interactor, this vocal information, through the Macintosh computer could 
speak to the micro-processor-based stepper motor controller which, in turn, 
controlled the pan-head arrangement of 3-axis camera movement, pan, tilt 
and rotation. 
Again, audio composition was affected by precisely whal matenal could 
be interpreted by the pitch rider and, therefore, by the carnera motors 6nd 
ultimately By all controllable devices. 


Notational Susteny _ 
One of the eSpects of this project is to develop 6 natational system by 


which predictable resulis can be achieved, i.e., connecting sonic material to 
its direct relational result. In this case, the sound source, the voice 1s the 
sole analog element and must be translated into digital information Defore 
it exists on the operational level of control. 


Theatrical extensions nit DAVES A. 

in additionalj\to the above-mentioned control parameters enabling the 
voice, through these devices, to contro] lighting, sound sequences, camera 
motors, etc., the voice will also be capable of triggering variable-speed 
tape recorders, thus establishing a mode of choosing images, the variablity 
(velocity) of these image sequences and direction of pre-recorded scenes. 
This concept points toward the possibility of virtual memory-based scenes, 
the future frontier of dramatic media-Dased presentations. 


¥ideo sample 

The video sample enclosed with this repart includes documentation of 
ihe work process 45 well as excerpts for the werk-in-progress, “Events in 
the Elsewhere’, 

The work process segments include: 

(1) backstage equipment set-up and onstage live performance of direct 
sound/image response (Center for Contemporary Arts, Santa Fe) 

(2} Morton Subotnick, Woody ‘asulke and Joan La Barbara (Steins as 
camera-operator) at work in Agua Fria studio on voice activation of camera 
motors. 

(3) Mark Coniglio and Joan La Barbara (Steina and Woody operating 
cameras} at work on Coniglio-developed MIDI-dancer equipment and pitch 
rider, allowing motion and sound cantroi of sound sequences. 

(4) animated and static space definitions - computer graphics 


Excerpts from “Events in the Elsewhere” 


video image sound material 
expanding and contracting universe inhaled/exhaled breathing 
protagonist, stationery in chair (silent) 


hegins to imagine device as means of escape 
graphic skeletal comera appesrs in upper corner 
mouth starts to open 


cut to camera in sun, sound activated modified mator 

cut to camera in architectural space (de Chirico) (silent) 

hand “pushing” video image voice activating cameras 

hody/‘statues flying in space voice affecting cameras 
and video feedback 

signing over umbrells Sampled voice ta include: 


(Chinese, Hopi, German spoken texts focussing on theoretical physics} 

computer graphic of face stretched over pyramid sampled voices 

birds pulsating modulated voices 

negative desert as alternate reality, slo-mo moduiated voices, 

electronic sounds 
Gaia, motion/sound bresking light barrier modulated voices 
elevator dours open to reveal alternate realities: 
rocks, steam, bridge 


(pa 


OUTLINE /DESCRIPTIONS 


Descriptions of various processes 


| — Direct sound/image response (Voice Windows) 


real-time performed 

singer directly controiis image in real time 

“space 1S pre-recorded 

Images ere pre-recorded 

layering done as performance (Aqua Fria and CCA performances} 

interaction of voice and image: initiated by instant response into this 
pre-recorded visual instrument. Composition was established by best- 
Suliable aesthetic interface between elements of voice and image 

matte: 

direct syntatic input = key 

rail 

matte (cuts hole) or mask (obstructs image} 

cut between matte and mask 

b/w two separate images 

wayve-form arrenged sesthetically 


video is locked into two frequencies: 13750 cycles per second = 
horizontal: 60 cycles = vertical 

hold image in frame of position 

to interact, one has to select frequencies whith are hermanics to these 
fundamentals (of ty frequencies) to hold/ stabilize the image 

looking in vaice far frequencies to develop heterodyne, etc. 

influence coherent reiationship between voice and television frame 

detailed modulation patterns using audio and video plrocesses = 
accumulated techniques 

audio related as aesthetic perceptual unit 

cohesive relationship as visible image 


RE Scan processor - snalag 
related to television scanning rates Bul rates are programmable 
has its own asciliators 
conditioned yoice - converted audio analog signal into control 


parameters 

spectrum of voice into more sultadle into 

amplitude 

fijlering 

voltage 

certain frequency patterns 

voltage and frequency send (interface w/) scan processor 

Into coherent tv frame 

used video info as standard video 

by re-scanning coherent frame trom scan-processor thru camera into 
video information 

infe from scan processor is fed as TY signal into standard video mixer 
where it is used In various modes, mostiy as mode external keyu 

to provide syntactic relationship between two video images 

establishing relationship 

modulating relationship between 4 or 6 pre-recorded video images 

certain aspects of sound source(voice) 

learning instrument from visual aspect 

sound material had to be focussed 

other material could be included but onlycertain aspects were affecting 
image 

intuitive process 


if - yoice to mic to pitch rider 
translated analog to digital MIDI code 


software in computer (Interactor = MAC} 

speaks to micro processor-based stepper motor controller which 
controlls pan-head = arrangement of 3-axis camera movement —- pan, it, 
rotation 

difficulties of developing notational scheme re cvoice accessing 3-axis 
controller 

pre-conceived pitch material to affect motion 

voice is sole analog 

digital 15 operational level 


syntactic device of stage 
voice spece speed and directions 


VIDED 
1~ physical movement and sound = MiDI dancer 
2- yvaice onto image - Voice Windows 
3- spatial orientation of voice-controlled camera head 
4- choreography of interface = score system 

desire to create new notational language 
2- @dditianal video infe 

Gaia = movement/voice interaction 

concept 
6- voice control of tape 

extention of pan-head concept in theatrical use of pan-head as 
perfarmer/peinter (device) we have extended cancept of pointer as possible 
to operate YTR in variable-speed mode with seamless made of chasing 
image where again voice is the major control source to the variability 
(velacity) and direction of pre-recorded scenes. 

This concept is paintint towards possibility of virtual memory-based 
scenes which is the future frontier af Gramatic media-based presentations. 


